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Abstract 

A characteristic feature of the non-equihbrium dynamics of real 
spin glasses at low temperatures are strong aging effects. These 
phenomena can be manipulated by changing the external param- 
eters in various ways: a thermo-cycling experiment consists for 
instance of a short heat pulse during the waiting time, by which 
the relaxation might be strongly affected. Results of numerical 
experiments of this kind, performed via Monte Carlo simulations 
of the three dimensional Ising spin glass model, are presented. 
The theoretical implications are discussed and the scenario found 
is compared with the experimental situation. 
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1 Introduction 



The non-equilibrium dynamics of spin glasses has been a major focus of re- 
search activity since the seminal work of Lundgren et al. [IH of 1983. Two 
years later the so called aging phenomena of spin glasses became manifest, 
when experimentalists realized that magnetic properties of spin glasses 
depend strongly on the time they spent below the freezing temperature Tg. 
These effects are a consequence of the extremely slow dynamics of spin glasses 
at low temperatures, regardless of the existence of an equilibrium phase tran- 
sition (for an overview of their equilibrium properties see [Q). 

Following the arguments of the droplet theory one imagines the dy- 
namical process at low temperatures to be governed by a growth of do- 
mains, which will reach some typical size after a certain waiting time. This 
length/time scale becomes manifest in a crossover observable e.g. in the 
thermo-remanent magnetization decay (see also On the other hand, 

inspired by Parisi's solution of the mean-field model of spin glasses 0, it has 
been proposed that the many metastable states existing in the rough free 
energy landscape of spin glasses might be organized in a hierarchical way|^]. 
Dynamics then explores states with decreasing free energy, and the escape 
from these valleys becomes harder, which means that it takes longer time. 
In this way the depth of the valley reached during the waiting time becomes 
manifest again as a crossover in observable quantities (see also [§]). 

Thermo-cycling experiments consist of two temperature changes within 
the spin glass phase either a short heat pulse is applied to the spin 
glass during the waiting time after which the relaxation of e.g. the thermo- 
remanent magnetization is measured, or a short negative temperature cycle 
is performed. It has been pointed out that this kind of experiments can 
discriminate between the droplet picture and the hierarchical picture. 

Within the hierarchical picture a heat pulse experiment and a negative 
temperature cycling experiment should have an asymmetric outcome: The 
hierarchical organization of the metastable states depends on temperature 
in such a way that the free-energy-valleys split into several, steeper valleys 
with decreasing temperature. Here an escape becomes even more difficult, 
resulting in a freezing of the aging process during a negative temperature 
cycle. Upon heating several valleys melt together, thus facilitating the escape. 
After completion of the cycle the system is again in a narrow valley with 
a higher free energy, similar to the beginning of the experiment and thus 
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restarting the aging process. Experiments using the insulating spin glass 



CdCr1.7Ino.3S4 P, 10| can be nicely interpreted within this picture. 



On the other hand within the droplet theory a heat pulse experiment 
and a negative temperature cycling experiment should have qualitatively a 
symmetric outcome: in both cases the domains that have grown so far should 
be reduced in size (or even destroyed) by the temperature cycle, and thus 
reinitialize the aging process. This is a consequence of the fact that spatial 
correlations among equilibrium spin glass states at different temperatures 
below Tg are short ranged with a typical length scale decresing rapidly with 
increasing temperature difference 0, 0. Experiments in Cu(Mn) spin 
glasses and Cu(Mn) spin glass films [|l^ have reported a scenario that 
speak in favor of this interpretation. 

Besides these two phenomenological approaches cited above some suc- 
cess has been made very recently in the analytical and numerical investiga- 



tion of microscopic mean-field models of aging in spin glasses [O, 116 



or related, simplified models |]T^ |T8|. However, up to now the study of mi- 



croscopic models of aging phenomena in two- or three-dimensional model 
of spin glasses had to be performed exclusively via numerical simulations 
[ p^ , pO| . Here not only a qualitative agreement among simulation results and 
simple aging-experiment (without temperature cycle) could be established, 
but also numerical values for various exponents determining the functional 
form of the decay of the thermo-remanent magnetization have been shown 
in to be the same in certain spin glasses (Fea;Ni(i_^))75Pi6B6Al3 and 
Feo.5Mno.5Ti03) and the three-dimensional Edwards-Anderson model with 
a heat-bath dynamics. 

One might ask, whether temperature cycling in Monte-Carlo simulations 
will also show such a remarkable concurrence with the experimental scenario. 
In this paper we present the results of such simulations. In the next section we 
introduce the model, give some numerical details and define the quantities 
that have been calculated. In section 3 we present the results, which are 
discussed in section 4. 



2 Numerical Procedure 



The system under consideration is the same as in ||20|, the three-dimensional 
Ising spin glass model with nearest neighbor interactions and a discrete (± J) 
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bond distribution. Its Hamiltonian is 

H = -^JijCTiCTj - h^ai , (1) 

where the spins cTj = ±1 occupy the sites of a L x L x L simple cubic 
lattice with periodic boundary conditions and the random nearest neighbor 
interactions Jij take on the values +1 or —1 with probability 1/2. The 
quantity h is an external magnetic field. The dynamics is the so called 
Metropolis algorithm, defined by the probability for single spin fiips 

w{ai -or,) = min{l, exp{-AE/T)} , (2) 

where AE is the energy difference between the old state and the new state 
in which the spin at site i is flipped. The most efficient implementation of 
this algorithm on a Cray-YMP has been used (see |2^ for details). 



To mimic the temperature cycling experiments [T0|, |TT], |T2[ the follow- 
ing procedure has been applied: First the system is initialized in a random 
state at a temperature T < Tg ^ 1.2 {Tg is the freezing or spin glass transi- 
tion temperature of the model (|l|), see however, note also [^), which 
corresponds to a fast quench from the paramagnetic phase into the spin glass 
phase. Then the system is kept at the temperature T for a flrst waiting time 
tyji, during which the initial aging takes place. Note that time is measured 
in Monte-Carlo seeps through the lattice. Then the temperature is changed 
to Tp, which is larger than T in a heat pulse experiment and smaller than 
T in a negative temperature cycle experiment. The system is kept at the 
temperature Tp for a time tp. Finally the cycle is completed by changing 
the temperature back again to the initial temperature T, where the system 
is aged again for a time 1^2- After this time (note that up to this point 
^age = tyji +tp + tw2 Monte-Carlo sweeps have been done). 

We performed two different kind of experiments: In the flrst the whole 
simulation is done in zero fleld, and we stored the spin conflguration at time 
tage and measured its overlap with the spin conflgurations of the system t 
Monte-Carlo steps later: 



i 

Here (■ ■ ■) means a thermal average (i.e. an average over different realizations 
of the thermal noise, but the same initial conflguration) and the bar means 
an average over different realizations of the bond-disorder. 
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In the second experiment we keep the system within an external field h 
during the whole temperature cycling procedure and switch it off after the 
the procedure has been completed (i.e. after tage)- From that moment on the 
thermo-remanent magnetization 



MTRM(t, tagc) = ^ E + ^agc)) , (4) 

is measured. This field-cooling experiment is exactly what is done with real 
spin glasses |P, |10|, |TT|, |12|. 



The linear system size of the samples is L=32 (i.e. ~ 3 ■ 10^ spins), and we 
averaged over 256 different realizations of the disorder. There are no finite 
size effects observable within the time scale of 10^ Monte-Carlo steps, which 
means that the typical correlation length (or linear domain size within the 
language of the droplet picture) is still smaller than half of the linear system 
size after t = 10^. We believe that our results do not depend significantly 
on the choice of the dynamics (Q). Let us adopt the point of view that spin 
glasses are critical for all temperatures below the spin glass transition tem- 
perature Tg (note that the correlation length in the frozen phase is infinite 
for all temperatures). In this case we would expect that any microscopic dy- 
namics without order-parameter conservation (model A in the classification 
of Hohenberg and Halperin [^]) will give the same universal results for all 
temperatures below Tg as long as the spins are of Ising type and the interac- 
tions are short ranged (so, for instance, also in the case of the short-ranged 



Ising spin glass Feo.sMuo.sTiOs [^. As soon as one considers e.g. Heisen- 
berg spins or RKKY-interactions the quantitative behavior might change, 
although we have nor reason to believe that the qualitative picture of the 
results presented here changes significantly. 



3 The correlation function C(t,tage) 

The autocorrelation function C(t,tage) defined in equation (^ measures the 
overlap of spin configurations at time t + tage with that achieved after aging 
the system for a time t^i at temperature T, exerting a heat pulse of dura- 
tion tp with temperature Tp and finally aging the system again for a time 
t^2 at temperature T. In figure 1 we choose T = 0.7, t^i = 10"^, tp = 10^, 
tw2 = lO^(a), 10^(6) and various heat pulse temperatures Tp. In figure 1 one 
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observes that the short heat pulse diminishes the correlations and C(t, tage) 
varies smoothly between the two curves obtained hj Tp = T (no heat pulse) 
and Tp = oo. The latter curve is identical to that obtained by simple aging 
with waiting time since Tp = oo destroys all correlations grown during the 
first waiting time t^i. Thus the heat pulse tends to reinitialize aging, how- 
ever, not completely as long as Tp is not high enough. Partial re-initialization 



has been observed in some experiments 12 1. On the other hand, figure 



1 is at variance with other experiments ||^, |T0|, where aging is fully reinitial- 
ized by applying a heat pulse of temperature only slightly above T and still 
significantly below the freezing temperature Tg. 

In figure 2 the same parameters as above are used up to the duration of 
the pulse, which is now tp = 10^. Note that now the heat pulse is only one 
decade shorter than the first waiting time t^i and one observes differences to 
figure 1: For Tp = 1.0 and 1.3 the correlations are larger at long times t than 
those without heat pulse. One possible interpretation is that on one side the 
longer heat pulse destroys some of the correlations originating from the first 
aging (note that for small t all curves with Tp > T he below Tp = T), but 
drives the system into energetically more favorable states (deeper valleys) like 



in simulated annealing |26|. Thus it is harder for the system to escape from 
the vicinity of the state reached after tage, which enhances the correlations 
at long times. 

This picture is supported by figure 3, where T = 0.7, Tp = 1.0 and 
the sum of first waiting time and duration of the heat pulse is kept constant: 
twi+tp = 1000. The longer the heat pulse the larger the correlations C(t, tage) 
at large times t. For comparison we have inserted a plot of the function 
C{t,tw = 10^) obtained by simple aging with a much longer waiting time 
f = 10^ ^ f 

^ ''age* 

This effect is completely absent if one performs a negative temperature 
cycling experiment with the same data for t^x^ tp and t^2- The result for 
T = 0.9 and Tp = 0.7 (note that now Tp < T is depicted in figure 4: For 
increasing duration of the "cold" pulse the correlation function C(t,tage) is 
clearly diminished. It seems that aging is partially frozen during the negative 
temperature cycle, the system cannot reach valleys as deep as those it would 
explore during simple aging at temperature T (corresponding to the tp = 
curve). However, freezing is only partial, since compared with the simple ag- 
ing curve C(t, t^ = ^^2) the correlations are still higher. Let us conclude this 
section with this observation of a clear asymmetry between heat pulse exper- 
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iments shown in figures 1-3 and negative temperature cycling experiments 
shown in figure 4. 



4 The magnetization M(t, tage) 

The correlation function that has been investigated in the last section is hard 
to measure in experiments with real spin glasses. Nevertheless it has a phys- 
ical meaning and it yields the same information as the usual susceptibility- 
measurements in equilibrium (because of the fluctuation-dissipation theo- 
rem, see 0, ^) and additional information in non-equilibrium. In this 
section we perform the following procedure already mentioned in section 2, 
which mimics exactly the experimental situation described in ||^, |TT], [1^: the 



temperature cycle is done within a weak external fleld, by which a magneti- 
zation is induced. After the completion of the cycle the fleld is switched off 
and the decay of the (thermo)-remanent magnetization @ is measured. 

We show in the following results for rather strong magnetic flelds {h = 
0.5), for the simple reason that the data are less scattered, since the signal 
(magnetization) is stronger. We performed also simulations for h = 0.2 and 
h = 0.1, which give qualitatively the same results. The differences originating 
in the fact that h ~ 0.5 is certainly outside the linear response regime are 
not observable on these time scales. 

In flgure 5 we depicted the results of heat pulses with various temper- 
atures. The initial aging temperature was T = 0.7 and ty^i = 10^, the 
duration of the pulse was tp = 10^ and the flnal waiting time is ty^i = 10^. 
For comparison the remanent magnetization obtained from simple aging at 
temperature T = 0.7 and waiting time tw = 10 is shown. One observes that 
the heat pulse diminishes the magnetization for times smaller than 0.1 ■ t^i, 
like it does with the correlations in flgure 1. The aging process is again only 
partially reinitialized, the temperature of the heat pulse has to be very high 
nullify the magnetization obtained during the flrst waiting time ty^. This 
is of course a consequence of the high magnetic fleld, for smaller magnetic 
flelds the temperatures needed to completely re-initialize the aging process 
are signiflcantly smaller. 

Furthermore one observes that for t > 0.2 ■ t^i the heat-pulse is able 
to enhance the magnetization, an effect that becomes more pronounced the 
longer the heat pulse is. This effect can be interpreted in the same way as 
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in the preceding section about the correlation function C(t, tagc)- Here the 
heat pulse destroys some of the magnetized domains of the system, how- 
ever not completely. Simultaneously it drives the system into energetically 
more favorable states, which have a non-vanishing magnetization. After the 
completion of the temperature cycle the initial magnetization is smaller, but 
it takes longer to escape from this magnetized state and to approach zero 
magnetization. 

Again, if this picture is correct in essence, one might expect a different 
outcome in a negative temperature cycle experiment. In figure 6 we show 
such an experiment with T = 0.9 and cycle temperature Tp = 0.6 (note that 
Tp < T now). The initial waiting time is t^i = 10^, the final waiting time is 
tw2 = 10^. For increasing heat pulse length tp the remanent magnetization 
is either unchanged or shghtly increased for all times t. Thus the negative 
temperature cycle destroys nothing of the magnetization obtained during the 
initial aging process. The magnetized domains continue to grow during the 
cycle (however, at a much smaller rate), for comparison the magnetization 
curve obtained for simple aging at T = 0.9 with a waiting time = 10^ 
is shown, which shows a still larger magnetization than that of negative 
temperature cycling with tp — 10^. 

We conclude that TRM-measurements in temperature cycling experi- 
ments manifests again an asymmetry between heat pulse and negative tem- 
perature cycle experiments and therefore yield the same picture as that ob- 
tained from the calculation of the autocorrelation function C {t, tage) described 
in the last section. 

5 Discussion 

In this section we will summarize and discuss the results of the numerical 
experiments presented in this paper. By calculating the autocorrelation func- 
tion C{t, tage) and the thermo-remanent magnetization Mtrm(^, ^age) we tried 
to explore the effect of temperature cycling on the aging process within the 
three-dimensional Ising spin glass model. We demonstrated that by a heat 
pulse, which is short compared to the initial waiting time, the aging process 
is partially re-initialized. On the other side, a negative temperature cycle 
experiment partially freezes the system into the (domain)-state reached dur- 
ing the initial aging process. Some experiments on real spin glasses show a 
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much clearer outcome p, |T0|, which, nevertheless, might be interpreted to 



concur with our observation. And finally — as pointed out in |]T0| — this 
asymmetry would pledge in favor of the hierarchical picture mentioned in the 
introduction and against the droplet picture. 

However, our results are on a very qualitative level and the dynamical 
processes involved are still microscopic on a logarithmic time scale. Thus 
it might be hard to verify one phenomenological, macroscopic theory and 
falsify another on the ground of our numerical data, although they have 
been obtained by state-of-the-art simulations with the most efficient exist- 
ing algorithm implemented on one of the fastest computers of today. The 
parameter space for this kind of experiments is essentially six-dimensional 
(T, Tp, t^i, tp, tyj2 and /i), therefore a systematic investigation, as was done 
for simple aging experiments in the same model pO| , seems to be forbidden. 
Therefore we had to confine ourselves to demonstrate what kind of scenario 
for temperature cycling experiments is obtained for the model, time scales 
and quantities under considerations and can only offer a possibly speculative 
interpretation. 

Furthermore we would like to point out that very strong crossover phe- 
nomena are observable within our results as soon as the duration of the heat 
pulse of the final waiting time become comparable to the initial aging time. 
We interpreted them within a picture of a relaxation in a rough free energy 
landscape, which again seems to be most appropriate for the results we ob- 
tained. This picture is rather fiexible and is able to explain a lot of features 
in a frustrated system — real or theoretical, and regardless of the existence 
of a phase transition. One of the phenomena that are fully neglected in a 
theory that is based on the assumption of a relaxation within a complicated 
free energy landscape is that of the growth of spatial correlations during the 
aging process. They are on the other side the basic ingredience of the droplet 
model 0]. Although both theories seem to make contradicting predictions 
(e.g. the symmetry or asymmetry of heat pulse and negative temperature- 
cycling experiments) our impression is that they have more in common than 
usually admitted. 

We think that it might be very useful to try to find a synthesis of both 
models, not only in order to be able to describe the growth of spatial cor- 
relations and their destruction by a heat pulse and their freezing during a 
negative temperature cycle. Domain growth has not been investigated by 
direct measurements up to now (for experiments that investigate this matter 
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indirectly see |T2| , p7| , p8|). However, in numerical simulations one has an 
immediate access to the quantities of interest and work on this subject is 
in progress P^. It is our impression, obtained from the results presented in 
this paper and in other publications that the simulation of finite di- 

mensional Ising spin glass models can make relevant predictions for real spin 
glasses, too, and will prove to be a very useful tool in testing and improving 
phenomenological theories for them. 
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Figure Captions 



Fig. 1 The spin autocorrelation function C(t,tage) defined in (H) in 
dependence of t (number of MC-steps) for various heat pulse 
temperatures Tp. The other temperature cycling parameters are 
T = 0.7, tyji = 10"^, tp = 10^ and = 10^ in the upper figure and 
tw2 = 10^ in the lower figure. From top to bottom it is Tp = T 
(o), Tp = 1.0, 1.3, 1.6, 1.9, 2.2, 2.5 (full lines) and Tp = oo (□). 
The error bars are significantly smaller than the symbols for the 
curves plotted with points. 

Fig. 2 Same as in figure 1, but with a longer duration of the heat 
pulse tp = 10^ and pulse temperatures (from top to bottom at 
t ~ 10^) Tp = T (o), Tp = 1.0, 1.3, 1.6, 2.0 (full lines) and Tp = oo 

(□)■ 

Fig. 3 C(t,ta.ge) in dependence of t with T = 0.7, Tp = 1.0 and 
tw2 = 100. The sum t^i + tp = 1000 is constant, from bottom 
to top it is tp = (o), tp = 10, 100, 300, 500 and 900 (full 
lines). The top curve (□) is just for comparison — it is the 
function C(t,t^ = 10^) obtained from simple aging with waiting 
time = 10^ 3> tago- 

Fig. 4 C(t, tage) from a negative temperature cycling experiment with 
T = 0.9, Tp = 0.7 (< T!) and t^2 = 100. As in figure 3 the sum 
twi + tp = 1000 is constant, from top to bottom it is tp = (o), 
tp = 10, 100, 500 and 900 (full lines). The bottom curve (□) is 
just for comparison — it is the function C{t,tw = 10^) obtained 
from simple aging with waiting time t^ = 10^ = tuj2- 

Fig. 5 The thermo-remanent magnetization MTRM(t,tage) defined in 
(^) in dependence of t (number of MC-steps) for various heat 
pulse temperatures Tp. The other temperature cycling parame- 
ters are T = 0.7, t^i = 10^, tp = 10^ and t^2 = 10^ From top to 
bottom (at t = 100) it is Tp = T (o), Tp = 1.0, 1.3, 1.6, 1.9, 2.2, 
2.5 (full lines) and Tp = oo (□). The error bars are significantly 
smaller than the symbols for the curves plotted with points. 



. 6 Mtrm(^! ^agc) from a negative temperature cycling experiment 
with T = 0.9, Tp = 0.6 (< T!), t^i = 10^ and t^2 = 10^ From 
bottom to top (at t = 1000) it is = (□), tp = 10^, 10^ 10^ and 
10^. The top curve (o) is just for comparison — it is the function 
^trm(^, = 10^) obtained from simple aging with waiting time 
t„ = 10^. 
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